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- The MAILING DATE of this communication appears on the cover sheet with the correspondence address - 
Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1.136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 
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earned patent term adjustment. See 37 CFR 1 .704(b). 
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5) n Claim(s) is/are allowed. 

6) 13 Claim(s) 1-24 is/are rejected. 
?)□ Claim(s) is/are objected to. 
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Application Papers 

9) D The specification is objected to by the Examiner. 
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11) 0 The proposed drawing correction filed on is: a)n approved b)n disapproved by the Examiner 
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* See the attached detailed Office action for a list of the certified copies not received. 

14) n Acknowledgment is made of a claim for domestic priority under 35 U.S.C. § 119(e) (to a provisional application). 
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DETAILED ACTION 
Claim Objections 

1 . Claim 24 is objected to because of the following informalities: This claim 
comprises a computer readable recording medium in the preamble which is 
dependent from a method claim. This is an inappropriate dependency. 
Appropriate correction is required. 

Claim Rejections - 35 USC § 103 

2. The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for 
all obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 1 02 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

A.) Claims 1, 2, 6-9, 13-16, and 20-24 are rejected under 35 U.S.C. 103(a) 
as being unpatentable over Tuceryan et al. (U.S. patent 6,044,168) and Holliman 
et al. (U.S. patent 6,075,557). 

Regarding claims 1 and 8: A method of extracting a face area from an 
image including a human face (Tuceryan et al.; fig. 1 elements 20, 21, and 23 
and col. 3 lines 8-13, where the face is localized in an image and localizing a 
face is read as extracting the face), the face extraction method comprising the 
steps of: 



Application/Control Number: 09/71 2,191 Page 3 

Art Unit: 2623 

carrying out position matching between the face template and the face 
area to be extracted, by moving, transforming and/or rotating the face template 
and/or the image according to an input from input means (Tuceryan et al.; col. 3 
lines 18-26 and col. 5 lines 1-13, where the positions of facial features are 
determined by correlating a template image to the image using a 1 1x1 1 window 
and using the result of the correlation of position matching to identify the facial 
feature in the image. The determination/location of facial features further 
localizes the face area in the image. Since a 1 1x1 1 window is used to correlate 
facial features implies that the template is moved around the image to find the 
regions that have the best correlation to the template image). 

extracting the face area based on a result of position matching (Tuceryan 
et al.; col. 4 lines 45-49 and col. 5 lines 10-28, where the face area is determined 
by template matching/correlation. The determination/localization of the positions 
of the facial features, such as eyes, mouth, etc. is also read as extracting a face 
area since these features are regions of a face). 

Tuceryan et al. discloses to localize/extract a face in an image(s) by 
template matching (Tuceryan et al.; col. 3 lines 8-17). Tuceryan et al. further 
discloses to display the predetermined facial templates (Tuceryan et al.; fig. 4 
and col, 4 lines 18-24) and the image(s) (Tuceryan et al.; fig. 6 and col. 4 lines 
48-51). Tuceryan et al. do not disclose to display the predetermined facial 
templates and the image together on a display. Holliman et al. teaches to display 
an image object/face and the border of an template simultaneously on a display 
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(Holliman et al.; col. 8 lines 55-56 and col. 1 1 lines 40-50). It would have been 
obvious to one skilled in the art to combine the teaching of Holliman et al. to that 
of Tuceryon et al. because they are analogous in object/face extraction from an 
image using template matching (Hollimann et al.; col. 1 1 lines 60-63). One in the 
art would have been motivated to incorporate the teaching, simultaneously 
displaying an image and a predetermined template modified to display the whole 
template and not just the border of a template, of Hollimann et al. to the face 
localization system of Tuceryon et al. to have a system which would allow an 
operator/individual to verify that the facial extraction process is being performed 
accurately and if any discrepancies in the facial extraction process are observed, 
by the operator, then the system can be fined tuned instantly. 

Regarding claims 2 and 9: A face extraction method wherein the step of 
extracting the face area comprises the steps of: 

calculating a degree of matching between the face template and the face 
area in accordance with the position matching (Tuceryon et al.; col. 3 lines 8-18 
and col. 5 lines 1-13, where the template matching /correlation gives a set of 
correlation values. This set of correlations is read as calculating a degree of 
matching.); and 

extracting the face area based on the degree of matching (Tuceryon et al.; 
col. 3 lines 15-18 and col. 5 lines 10-13). 

Regarding claims 6 and 1 3: A face extraction method wherein the face 
template has a different from a skin color (Tuceryan et al.; fig's 4 and 5 where the 
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templates are edge maps and/or wire frame models. These edge maps are read 
as templates having different color than skin since the edge maps are lines, such 
as black or white lines, in a background defining an object to be extracted from 
an image. The black or white color of the templates is read as a color different 
from skin color). 

Regarding claims 7 and 14: A face extraction method wherein the color 
different from the skin color is a complimentary color of the skin color (Tuceryan 
et al.; figs 4 and 5 where the templates are edge maps and/or wire frame models. 
These edge maps are read as templates having different color than skin since 
the edge maps are lines, such as black or white lines, in a background defining 
an object to be extracted from an image. The black or white color of the 
templates is read as a color different from skin color). 

Tuceryan et al. discloses to have templates that have a different color than 
skin color, as discussed above. Tuceryan et al. does not disclose to have the 
color of the template be a color which is complimentary of the skin color. It would 
have been obvious to one skilled to design the template wherein the color of the 
object/face in the template can be any color so that the simultaneous display of 
the template and the image can be distinguished more clearly. 

Regarding claims 22 and 23: A method of carrying out image processing 
on the face area extracted by using the face extraction method to the Image 
processing method comprising the step of: 
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converting a color tone of a desired area including the face area to a color 
tone of a predetermined target image. 

Tuceryan et al. discloses to have facial templates which are composed of 
edge maps and/or wire frame models (Tuceryan et al.; figs 4 and 5 where the 
templates are edge maps and/or wire frame models. These edge maps are read 
as templates having different color than skin since the edge maps are lines, such 
as black or white lines, in a background defining an object to be extracted from 
an image. The black or white color of the templates is read as a color different 
from skin color). Tuceryan et al. does not disclose to convert a color tone of a 
desired area including a face area to a color of a predetermined target image. It 
would have been obvious to one skilled in the art to convert the templates or 
images or face regions in the images to a specific predetermined color tone to 
show that a specific region of the image has been analyzed and/or the 
object/face located within the image. 

Regarding claim 15: It is rejected for the same reason as claims 1 and 8 
above and for the following limitation of: a computer readable recording medium 
(Tuceryon et al.; col. 2 lines 63-65, where the process is performed on a 
computer). 

Regarding claim 16: It is rejected for the same reason as claims 2 and 9 
above and for the following limitation of: a computer readable recording medium 
(Tuceryon et al.; col. 2 lines 63-65, where the process is performed on a 
computer). 
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Regarding claim 20: It is rejected for the same reason as claims 6 and 13 
above and for the following limitation of: a computer readable recording medium 
(Tuceryon et a!.; col. 2 lines 63-65, where the process is performed on a 
computer). 

Regarding claim 21 : It is rejected for the same reason as claims 7 and 14 
above and for the following limitation of: a computer readable recording medium 
(Tuceryon et al.; col. 2 lines 63-65, where the process is performed on a 
computer). 

Regarding claim 24: It is rejected for the same reason as claims 22 and 23 
above and for the following limitation of: a computer readable recording medium 
(Tuceryon et al.; col. 2 lines 63-65, where the process is performed on a 
computer). 

B.) Claims 3-5, 10-12, and 17-19 are rejected under 35 U.S.C. 103(a) as 
being unpatentable over Tuceryan et al. (U.S. patent 6,044,168) as modified by 
Holliman et al. (U.S. patent 6,075,557) and further view of Lee and Ranganath 
("3D Deformable Face Model for Pose Determination and Face Synthesis", 
Department of Electrical Engineering, The National University of Singapore, 
Image Analysis and Processing, International Conference Sept. 1999). 

Regarding claims 3 and 10: A face extraction method wherein the step of 
calculating the degree of matching further comprises the step of: 
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generating unsharp images of the face template and an area 
corresponding to the face template in the image; and 

calculating the degree of matching between the unsharp images. 

Tuceryon et al. and Holliman et al. both teach to use perform template 
matching to locate/extract an object/face in an image. Neither one teaches to use 
3D facial templates nor unsharpening images of the face template for template 
matching. Lee and Ranganath teach to use 3D models "templates" as well as 
deforming "unsharpening" the models "templates" to perform template matching 
for facial recognition (page 2 under #2. 3D Face Model and under #3. Model 
Matching and Pose Determination , where a 3D deformable model " template" is 
used to perform facial recognition and the 3D model is deformed to perform facial 
matching in an image). It would have been obvious to one skilled in the art to 
combine the teaching of Lee and Ranganath to that of Tuceryon et al. as 
modified by Hollimann et al. because they are analogous in facial recognition in 
an image. One in the art would have been motivated to incorporate the teaching 
of a using 3D models "templates" as well as deforming "unsharpening" the 
models "templates" for template matching/correlation, of Lee and Ranganath to 
that of Tuceryon et al. as modified by Hollimann et al. in order to identify a face in 
an image taken into consideration the different possible facial poses that may 
take place in a 3D setting (Lee and Ranganath; page 1 under #1 Introduction , 
last two lines of left column and first two lines in right column). 
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Regarding claim 17: It is rejected for the same reason as claims 3 and 10 
above and for the following limitation of: a computer readable recording medium 
(Tuceryon et al.; col. 2 lines 63-65, where the process is performed on a 
computer). 

Regarding claims 4 and 1 1 : A face extraction method wherein the face 
template has a three-dimensional shape (Lee and Ranganath; page 2 under #2. 
3D Face Model where a 3D deformable face model "template" is used). 

Regarding claims 5 and 12: A face extraction method wherein the three- 
dimensional shape is formed by a three-dimensional wire frame (Lee and 
Ranganath; fig. 1 block d, where the model is a wire frame model). 

Regarding claim 18: It is rejected for the same reason as claims 4 and 1 1 
above and for the following limitation of: a computer readable recording medium 
(Tuceryon et al.; col. 2 lines 63-65, where the process is performed on a 
computer). 

Regarding claim 19: It is rejected for the same reason as claims 5 and 12 
above and for the following limitation of: a computer readable recording medium 
(Tuceryon et al.; col. 2 lines 63-65, where the process is performed on a 
computer). 



Conclusion 



3. 



The prior art made of record and not relied upon is considered pertinent to 



applicant's disclosure. 



Application/Control Number: 09/712,191 



Page 10 



Art Unit: 2623 

Yamaguchi et al. (U.S. patent 6,608,914) for a feature recognition system 
using similarity values. 

Black et al. (U.S. patent 5,802,220) for tracking an individual through a 
sequence of images. 



the examiner should be directed to Anand Bhatnagar whose telephone number is 
(703) 306-5914, whose supervisor is Amelia Au whose number is 703-308-6604, 
group fax is 703-872-9306, and Tech center 2600 customer service office 
number is 703-306-0377. i 
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